Memory-based disfluency chunking
نویسندگان
چکیده
We investigate the feasibility of machine learning in automatic detection of disfluencies in a large syntactically annotated corpus of spontaneous spoken Dutch. We define disfluencies as chunks that do not fit under the syntactic tree of a sentence (including fragmented words, laughter, self-corrections, repetitions, abandoned constituents, hesitations and filled pauses). We use a memory-based learning algorithm for detecting disfluent chunks, on the basis of a relatively small set of low-level features, keeping track of the local context of the focus word and of potential overlaps between words in this context. We use attenuation to deal with sparse data and show that this leads to a slight improvement of the results and more efficient experiments. We perform a search for the optimal settings of the learning algorithm, which yields an accuracy of 97% and an F-score of 80%. This is a significant improvement of the baselines and of the results obtained with the default settings of the learner.
منابع مشابه
Proceedings of CoNLL - 99 , Bergen , Norway pp 53 - 60 Memory � Based Shallow Parsing
We present a memory based learning MBL approach to shallow parsing in which POS tagging chunking and identi cation of syntactic relations are formulated as memory based modules The experiments reported in this paper show competitive results the F for the Wall Street Journal WSJ treebank is for NP chunking for VP chunking for subject detection and for object detection
متن کاملHierarchical Chunking of Sequential Memory on Neuromorphic Architecture with Reduced Synaptic Plasticity
Chunking refers to a phenomenon whereby individuals group items together when performing a memory task to improve the performance of sequential memory. In this work, we build a bio-plausible hierarchical chunking of sequential memory (HCSM) model to explain why such improvement happens. We address this issue by linking hierarchical chunking with synaptic plasticity and neuromorphic engineering....
متن کاملShort-term Working Memory and Chunking in SLA
After elaborating the definition of working memory, the relationship between short-term memory and working memory, chunking in SLA and the relationship between short-term memory and chunking, this paper proves the importance of chunking through the experiment: the students’ capacity in fast reading, reading in depth, listening and cloze from experimental group was affected by vocabulary depth t...
متن کاملWhen disfluency is--and is not--a desirable difficulty: the influence of typeface clarity on metacognitive judgments and memory.
There are many instances in which perceptual disfluency leads to improved memory performance, a phenomenon often referred to as the perceptual-interference effect (e.g., Diemand-Yauman, Oppenheimer, & Vaughn (Cognition 118:111-115, 2010); Nairne (Journal of Experimental Psychology: Learning, Memory, and Cognition 14:248-255, 1988)). In some situations, however, perceptual disfluency does not af...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003